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ABSTRACT 


Analytical  and  experimental  investigations  of  1-D  and  2-D 
space-variant  optical  processors  have  been  conducted.  Areas 
investigated  have  included:  (1)  measures  of  the  degree  of  invari 
ance  of  linear  optical  systems;  (2)  a  real-time  holographic  CCD 
recording  technique  for  preserving  phase  information;  (3)  a  fast 
highly  parallel  architecture  for  optical  multiplication;  and  (4) 
complete  analytical  and  experimental  investigation  of  the  biline 
transform  and  its  applications. 
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Accession  For 


RESEARCH  OBJECTIVES 


During  the  period  of  the  grant,  from  September  30,  1984  to 
September  30,  1987,  the  major  research  objectives  have  been  to 
analytically  and  experimentally  investigate  the  optical  implemen¬ 
tation  of  space-variant  information  processing  operations.  Both 
one-dimensional  (1-D)  and  two-dimensional  (2-D)  signal  processors 
have  been  studied.  The  major  areas  of  investigation  have  been  (1) 
investigation  of  an  improved  measure  of  the  degree  of  invariance 
of  a  linear  system  and  its  application  to  piecewise  isoplanatic 
space-variant  systems;  (2)  a  process  for  generalized  real-time 
linear  filtering  of  1-D  signals  which  incorporates  a  CCD-based 
recording  technique  for  preserving  phase  information;  (3)  investi¬ 
gation  of  an  all  optical  technique  for  multiplying  binary  numbers 
with  a  high  degree  of  parallel  processing;  and  (4)  a  complete 
analytical  and  experimental  investigation  of  the  bilinear  trans¬ 
form  and  its  widespread  applications  including  programmable  opti¬ 
cal  interconnections,  triple  product  processors,  2-D  optical 
crossbar  networks,  optical  polynomial  processors  and  window  pro¬ 
grammable  image  processors.  Details  of  these  investigations  are 
provided  in  the  following  sections  and  in  the  referenced  publica¬ 


tions  which  have  resulted  from  the  research. 
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SUMMARY  OF  RESULTS 

In  consideration  of  the  large  number  of  journal  publications, 
conference  proceedings  and  the  scientific  report  resulting  from 
this  research,  we  will  briefly  summarize  the  major  results 
obtained  in  this  section,  with  references  made  to  the  appropriate 
publications  and  report. 

1 .  Measures  of  Invariance  of  Linear  Systems 

It  has  previously  been  shown  by  our  group  that,  for 


bandlimited  inputs,  a  space-var iant  linear  system  can  be  exactly 
characterized  by  knowledge  of  the  sampled  system  point  spread 
function  and  the  corresponding  sampled  input. *'2  Optical  proces¬ 
sors  based  on  the  sampling  technique  have,  to  date,  encountered 
rather  severe  limitations  in  terms  of  input  resolution,  dynamic 
range  and  space-bandwidth  product  requirements  for  the  system 
components.  The  implementation  of  space- var ian t  optical  proces¬ 
sors  based  on  the  piecewise  isoplanatic  approximation  (PIA) 
should  alleviate  some  or  all  of  these  restrictions,  since  the  PIA 
uses  "coarse"  sampling.  The  approximation  employed  divides  the 
linear  system  input  plane  into  isoplanatic  patches  to  which  corre¬ 
sponding  point  spread  functions  are  assigned.  The  resulting  PIA 
system  output  is  an  approximate  representation  of  the  true  system 
output . 

During  this  funding  period,  a  new  measure  of  the  degree  of 
invariance  was  developed  as  a  tool  to  classify  linear  sys¬ 
tems.  3,4,5  This  new  measure  seems  to  predict  the  relationships 
between  the  true  and  PIA  system  outputs  better  than  the  classical 
Lohmann  and  Paris  measure. 5>6  with  the  aid  of  the  new  measure, 


1 


3 


we  showed  how  to  find  the  optimal  size  of  each  isoplanatic  patch 
in  the  input  plane  and  the  optimal  corresponding  impulse  response 
in  each  patch.  Finally  the  relationship  of  the  variation  band¬ 
width  to  the  new  measure  of  invariance  was  studied  and  found  to 
support  the  validity  of  the  new  measure. 

2 .  Real-time  Holographic  CCD  Recording 

This  project  investigated  a  technique  for  optically  perform¬ 
ing  generalized  coherent  linear  filtering  of  1-D  signals.  A  key 
element  in  the  success  of  the  processor  is  the  use  of  a  real-time 
holographic  recording  technique  at  the  output  of  a  1-D  space- 
variant  processor . ^ # 8  in  this  recording  scheme,  the  intensity  of 
the  sum  of  the  filtered  signal  and  an  on-axis  reference  beam  is 
integrated  by  a  charge-coupled  device  (CCD)  array.  The  bias  term 
is  subsequently  removed  electrically,  yielding  the  desired  signal 
term  with  amplitude  and  phase  information  preserved.  Though  some 
problems  were  encountered  due  to  a  spa t ial ly-var y ing  CCD  array 
response,  we  believe  these  problems  can  be  solved.  One  related 
result  of  interest  is  the  ability  of  the  processor  to  simulate  the 
performance  of  parametric  amplifiers.  Experimental  results  were 
obtained  demonstrating  both  space-invariant  and  space-variant 
applications.  A  Hilbert  transform  processor  and  a  bandpass  filter 
were  two  of  the  applications  which  were  successfully  demonstrated. 

3 .  Architectures  for  Optical  Binary  Multiplication 

The  main  goal  of  this  project  was  to  apply  optical  space- 
variant  processing  techniques  to  the  area  of  discrete  numerical 
computations,  primarily  binary  arithmetic.  The  particular  prob¬ 
lem  of  implementing  binary  multiplication  was  chosen  because  it 


contains  the  major  operations  required  of  a  computer's  arithmetic 
logic  unit. 

Our  initial  approach  of  color-encoding  the  multiplier  data 
and  using  feedback  to  convert  from  mixed  binary  to  binary 
format^'lO  was  then  found  to  require  too  many  passes  through  the 
Hughes  Liquid  Crystal  Light  Valve  and  was  consequently  too  slow. 

A  new  approach  was  taken  which  first  forms  all  the  partial  prod¬ 
ucts  simultaneously  in  parallel . H 1 2  We  then  regroup  the  bit 
products  thereby  obviating  the  necessity  of  the  "shift"  opera¬ 
tion.  Finally/  we  optically  perform  carry  look-ahead  addition  of 
the  resulting  binary  words  to  get  the  final  product.  The  number 
of  intensity  levels  is  restricted  to  three/  as  before/  preserving 
the  noise  immunity  and  thus  providing  high  accuracy.  The  multi¬ 
plier  and  multiplicand  bits/  encoded  in  bright  true  logic,  are 
introduced  in  bar-shaped  patterns  onto  the  WRITE  and  READ  sides  of 
a  Hughes  LCLV.  The  analyzer  is  kept  crossed  with  respect  to  the 
direction  of  polarization  of  the  incoming  beam.  The  AND  operation 
performed  results  in  the  formation  of  an  array  of  partial  prod¬ 
ucts.  The  bit  products  are  then  regrouped  diagonally  to  form  new 
binary  words.  Entire  partial  products  need  no  longer  be  shifted 
in  this  case.  These  binary  words  are  then  added  to  get  the  final 
product.  An  algorithm  for  optical  carry  look-ahead  addition  was 
conceived,  and  implemented  in  an  optical  arrangement  which 
produces  all  the  carries  in  essentially  one  switching  time. 
Proof-of-pr inciple  experiments  were  conducted  to  (a)  form  t.he 
array  of  partial  products  and  (b)generate  the  carries.  These 
experiments  confirmed  the  validity  of  the  new  techniques.  The 


proposed  system  offers  a  better  solution  to  the  problem  of  the 
propagation  of  carries  than  earlier  approaches  utilizing  residue 
arithmetic.  It  performs  a  multiplication  in  only  13  switching 
times  of  the  LCLV.  It  utilizes  the  spatial  parallelism  of  optical 
systems  to  perform  a  number  of  multiplications  and  additions  in 
parallel,  and  thus  could  become  the  processing  unit  of  a  very  fast 
optical  matrix  multiplier.  To  illustrate  the  speed  of  the  archi¬ 
tecture  developed/  if  the  basic  response  time  of  the  LCLV  were 
20  nsec  rather  than  20  ms /  the  system  could  be  capable  of  perform¬ 
ing  approximately  4  million  8-bit  multiplications  per  second. 

We  also  discussed  techniques  by  which  this  fast  optical 
multiplication  architecture  could  perform  real  time  matrix-vector 
multiplication,  thus  widening  its  range  of  applicability  to  linear 
algebra  processors.  In  summary,  we  firmly  believe  that  with  the 
advent  of  even  faster  spatial  light  modulators,  this  very  fast 
optical  binary  multiplication  architecture  will  generate  even 
wider  interest  than  that  generated  to  date. 
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4 .  Bilinear  Optical  Processing  and  Applications. 

A.  Introduction 

During  this  funding  period,  we  have  investigated  extensions 
of  our  previous  space-var ian t  work  to  the  new  area  of  2-D  non¬ 
linear  space- var ian t  processing.  In  particular,  we  concentrated 
on  potential  applications  in  the  area  of  optical  computing.  As  a 
start,  we  investigated  the  simplest  nonlinear  system,  i.e.  the 
bilinear  spac e- var ian t  system.  As  a  result,  a  general  mathemati¬ 
cal  model  was  devel oped , 1 3 > 14  several  optical  implementation 
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techniques  were  designed/  and  a  number  of  application  areas  were 
studied . 15-21  §  24 /  27 ,  28 
B.  Mathematical  Formulation 

A  1 -D  bilinear  space-variant  operation  can  be  described  by 


g(y)  = 


// 


h(y;x'/x")  f  * ( x  * )  f"(x")  dx'  dx" 


where  f'  and  f"  are  two  inputs/  g  is  the  output  and  h  is  the 
kernel  of  the  system.  This  equation  is  also  known  as  the  bilinear 
transform.  A  characteristic  of  this  transform  is  that  if  one  of 
the  inputs  is  fixed/  then  the  transform  becomes  a  generalized 
linear  transform.  The  properties  of  this  bilinear  operator  have 
been  studied/  resulting  in  a  new  set  of  space-variant  system 
classifications.  This  added  "richness"  to  the  class  of  space- 
variant  systems  gives  rise  to  new  implementations  and  applications 
in  the  area  of  optical  computing. 13 
C.  Implementations 

(1)  Using  2-D  linear  space- var ian t  processors. 

We  have  shown  that  if  we  use  the  output  of  a  2-D  linear 
space-variant  processor  which  lies  on  a  45°  line  with  respect  to 
both  output  axes /  change  the  4-D  kernel  into  3-D  kernel  and  apply 
two  inputs  on  the  orthogonal  axes  of  the  input  plane/  a  1-D  bi¬ 
linear  transform  is  realizable. 

(2)  Phase  grating  technique  with  a  liquid  crystal  light 
valve  ( LCLV ) . 

By  using  LEDS  (input  f"(x"))  at  different  locations/  each  LED 
can  produce  a  different  spatial  grating  on  the  "WRITE"  side  of  an 
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LCLV  (if  a  reference  beam  is  added).  Based  on  performing  the  AND 
operation  on  the  LCLV/  the  input  f’(x')  on  the  "READ"  side  of  the 
LCLV  will  be  imaged  at  different  output  locations  where  we  place 
different  space-variant  holograms  (e.g.  multifaceted  holograms). 

In  this  way  a  2-D  bilinear  transform  is  achievable . 13 

(3)  Acoustooptical  processor 

Consider  the  light  incident  on  an  acoustooptic  cell  as  the 
first  input  f'(x')/  and  the  electronic  signal  input  to  the  acous¬ 
tooptic  cell  as  the  second  input/  f"(x").  By  frequency  modulation 
and  spatial  modulation  of  the  acoustooptic  cell/  any  combinations 
of  two  inputs  will  be  deflected  to  different  output  locations 
where  holograms  (kernels)  are  placed.  With  this  system  a  1-D 
real-time  bilinear  transform  can  be  performed. 15  using  a  multi¬ 
channel  acoustooptic  cell  will  improve  the  space-bandwidth  product 
requirements . 

D.  Applications 

A  bilinear  transform  in  discrete  form  can  be  represented  by  a 
triple  vector-matrix-vector  product/  i.e. 


N  M 


9  (  y )  =  ^  ^  ^ ^  f'(n)  h ( y ; n , m )  f”(m) 


n  =  1  n  =  l 


=  f'T  H  f” 


where  H  is  a  matrix/  '  and  f_^  are  two  column  vectors  and  T  repre¬ 
sents  the  transpose  operator.  The  following  applications  all  use 


this  discrete  formulation  of  the  bilinear  transform. 


(1)  Programmable  optical  interconnections.1'3 

By  using  as  a  control  input  and  fj_  as  a  signal  input,  the 
bilinear  transform  can  be  made  to  perform  programmable  optical 
interconnections.  By  changing  the  control  input,  the  system  can 
provide  various  mappings  between  signal  input  and  output.  This 
approach  offers  a  great  flexibility  in  logic  design,  since  tens  or 
hundreds  of  operations  can  be  performed  using  a  fixed  system. 

(2)  2-D  Cross-bar^? 

Let  H  be  a  2-D  input,  and  let  fj_  and  f"  be  two  control  inputs 
in  the  two  orthogonal  dimensions,  respectively.  By  changing  the 
control  inputs,  each  entry  of  H  can  be  mapped  to  different  loca¬ 
tions  in  a  2-D  output  plane.  Furthermore,  a  2-D  crossbar  can  be 
performed  in  real  time  if  real-time  SLMs(such  as  the  magnetooptic 
(LIGHT-MOD)  are  used  to  replace  the  two  control  inputs  f_|_  and  f "  . 

(3)  Triple-product  processing 

The  discrete  bilinear  transform  can  be  extended  to  triple 
matrix-matrix-matrix  products,  i.e.,  g(y)  =  F'  H  F".  Here  F',  F" , 
and  H  are  all  considered  signal  inputs.  This  triple  product 
processing  is  useful  in  image  processing.  It  can  also  be  used  to 
implement  a  generalized  eigensystem  if  feedback  is  considered. 


Secondly,  we  can  use  triple-product  processing  to  implement 
logic  designs  for  either  combinatorial  or  sequential  circuits. 
This  processor  can  also  operate  in  an  MIMD  (multiple  instruction 
multiple  data)  format. 

(4)  Bilinear  2-D  space- var  ian  t  processing^ 

A  generalized  discrete  1-D  optical  processor  with  a  2-D 


kernel  can  be  viewed  as  a  matrix-vector  multiplier. 


Since  most  of 


the  data  processed  in  optics  are  2-D,  we  investigated  a  general¬ 


ized  2-D  processor  which  has  a  4-D  kernel.  This  processor  can 
compute  the  output  in  one  time  step  given  the  entire  input  data/ 
which  is  in  contrast  with  a  regular  systolic  array  which  accepts 
time-serial  input  data  and  accumulates  the  output  over  many  time 
steps . 

To  explain  the  2-D  operations,  we  introduced  the  mathematical 
concepts  of  2-D  vectors,  2-D  matrices,  and  operations  such  as  a  2- 
D  inner  product,  outer  product,  matrix-vector  multiplication,  and 
matrix-matrix  multiplication.  Based  on  these  concepts,  we  con¬ 
structed  two  types  of  2-D  discrete  optical  processors,  i.e., 
direct  processors  and  back-projection  processors.  Two  specific 
applications  were  investigated.  A  2-D  version  of  the  Hopfield 
neural  net'  ork  was  developed  which  is  able  to  perform  2-D  neural 
operations.  Also,  combining  the  1-D  outer  product  operation  and  a 
2-D  data  format,  the  standard  matrix-matrix  multiplication 
operation  was  shown  to  be  easily  implemented  in  one  time  step. 

(5)  Optical  polynomial  processing^  >  21 

With  the  motivation  of  extending  bilinear  operators  to  a  more 
general  class  of  nonlinear  operators  via  a  Volterra  series 
(polynomial)  approximation,  optical  polynomial  processors^ ,  23 
with  high  speed  and  throughput  need  to  be  investigated  and  imple¬ 
mented.  We  examined  optical  polynomial  implementations  using  a 
factored  representation  so  that  the  bilinear  techniques  developed 
under  this  funding  can  be  employed.  Since  there  are  two  inputs 
and  one  kernel  in  the  generalized  bilinear  transform,  the  two 
inputs  act  as  polynomial  input  variables  and  the  elements  in  the 


kernel  represent  the  coefficients  of  the  quadratic  polynomial. 

Thus  higher  order  polynomial  processing  can  be  realized  by  iterat¬ 
ing  the  bilinear  transform. 


A  dual-LCLV  system  has  been  set  up  to  form  such  a  quadratic 
polynomial.  Using  electronic  or  optical  feedback/  a  general 
optical  polynomial  processor  is  achievable.  The  work  has  been 
extended  to  perform  bipolar  complex  analog  and  binary  digital 
polynomial  operations.  The  analog  operations  can  be  performed  by 
using  separate  parallel  channels  for  real/ imag inary  and  posi¬ 
tive/negative  numbers.  The  concepts  of  systolic  and  wavefront 
processing  can  be  used  to  implement  binary  digital  polynomial 
processing.  The  polynomial  system  for  digital  processing  has  been 
set  up  and  tested  in  the  lab  with  good  results. 

(6)  Window-Programmable  Image  Processors^ 

To  solve  the  problem  of  implementing  high  speed  processing  of 
large  amounts  of  data,  such  as  2 -D  or  3-D  images,  present  elec¬ 
tronic  computers  are  limited  due  to  their  fundamentally  serial 
nature.  One  approach  to  overcoming  this  problem  is  to  use  optical 
computing  systems  with  the  capabilities  of  parallel,  high  speed 
processing . 

We  designed  an  optical  system,  based  on  the  bilinear 
transform,  for  processing  2-D  images.  In  the  area  of  linear, 
space-invariant  image  processing,  the  output  images  can  generally 
be  expressed  as  the  convolutions  of  the  input  images  and  small 
window  functions.  In  other  words,  the  output  image  is  equal  to 


the  summation  of  the  shifted  input  images  which  correspond  to  the 
weights  and  locations  of  coefficients  in  the  window.  If  we 


interpret  one  of  the  inputs  in  the  bilinear  transform  as  an  input 
image,  the  other  one  as  a  window  and  the  kernel  as  shift  gratings, 
then  a  convolution-based  image  processor  can  be  looked  at  as  a 
bilinear  processor.  Experimental  results  were  obtained  demon¬ 
strating  bipolar  two-level  image  processing  where  edge-enhancement 
was  the  application  which  was  successfully  demonstrated. 

(7)  Optical  Multistage  Interconnection  Networks. 24 

This  project  was  motivated  by  our  2-D  optical  crossbar  imple¬ 
mentations.  Recently,  a  number  of  optical  interconnection  net¬ 
works  have  been  proposed  and  demonstrated  such  as  crossbar  net¬ 
works^  and  perfect  shuffle  networks. 26  jn  spite  of  their  feasi¬ 
bility,  however,  these  networks  only  deal  with  1-D  data  and  ignore 
the  inherent  3-D  characteristics  of  optical  systems.  Another 
major  problem  is  that  although  crossbars  are  ideal  networks  for 
interconnections,  crossbar  networks  of  large  size  are  very  diffi¬ 
cult  to  implement  either  in  optics  or  electronics.  An  alternate 
approach  is  to  design  multistage  networks,  with  each  stage  having 
a  number  of  crossbars  of  small  size.  Based  on  the  above  noted 
reasons,  we  believe  the  continued  investigation  of  2-D  optical 
multistage  interconnection  networks  (MINs)  is  very  important. 

We  have  proposed  the  framework  of  a  2-D  MIN  and  explored  the 
advantages  and  applications  of  the  2-D  perfect  shuffle  network, 
including  (1)  the  quaternary  number  representation  of  the  2-D 
perfect  shuffle  network,  (2)  reduction  of  the  number  of  stages  for 
realizing  all  permutations  between  inputs  and  outputs,  (3)  imple¬ 


mentation  of  a  2-D  FFT,  (4)  bivariate  polynomial  evaluation  and 
(5)  matrix  transposition.  Also  an  experimental  setup  for  a  2-D 


>1 


perfect  shuffle  demonstrate j  the  simplicity  of  an  optical  imple¬ 
mentation.  We  are  definite. y  en  r^ra^ed  by  the  results  obtained 
to  date  on  this  particulai  p  j  »  •  aru  we  believe  that  the  further 

investigation  of  the  2 -D  M : N  is  ct  jteai  interest  in  the  field  of 
optical  computing. 

(8)  A  2-D  Clos  Optical  Interconnection  Ne t wo r k . 2 7 , 28 

The  interest  in  devising  a  2-D  Clos  network  is  due  to  its  3- 
stage  layout  and  ability  to  implement  2-D  crossbar  networks  of 
large  size  using  a  number  of  subcrossbars  of  medium  size.  The 
Clos  network  has  the  same  characteristics  as  the  crossbar  network, 
but  an  important  factor  is  that  the  number  of  switching  elements 
has  been  reduced  in  the  Clos  network  (10:1  for  a  1000x1000  net¬ 
work,  as  compared  with  the  crossbar  network).  The  difficulty  of 
determining  routing  connections,  however,  is  a  major  problem  to  be 
overcome. 29  we  have  come  up  with  a  straightforward  algorithm  to 
route  the  Clos  network.  This  algorithm  can  be  performed  either  by 
a  uniprocessor  or  by  parallel  processors.  Also  the  routing  algo¬ 
rithm  is  not  unique,  and  the  possibility  for  alternative  choices 
gives  the  routing  algorithm  an  ability  to  tolerate  faults.  We 
have  demonstrated  an  optical  implementation  of  the  2-D  Clos  net¬ 
work  with  good  experimental  results.  A  2-D  Clos  network  can  also 
be  used  to  realize  2-D  neural  networks,  and  furthermore,  the 
neural  connections  are  programmable.  This  will  give  neural  pro¬ 
cessors  the  flexibility  to  perform  more  complex  computations. 
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tions  based  on  the  bilinear  transformation. 
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stage  interconnection  network  as  compared  to  crossbar  net¬ 
works  . 
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implementations  of  combinational  and  sequential  logic. 

A  complete  theory  of  the  generalized  bilinear  transform  was 
developed  and  many  properties  of  bilinear  systems  were 
examined. 


